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1. Introduction 

Giving a sense to the notion of mean behaviour may be counted among the very 
early activities of statisticians. When confronted to large data sample, the usual 
notion of Euclidean mean is too rough since the information conveyed by the 
data possesses an inner geometry far from the Euclidean one. Indeed, deforma¬ 
tions on the data such as translations, scale location models for instance or more 
general warping procedures prevent the use of the usual methods in data anal¬ 
ysis. This problem arises naturally for a wide range of statistical research fields 
such as functional data analysis for instance Ramsay and Silverman (2005), 

Bercu and Fraysse (2012) and references therein, image analysis in Trouve and Younes 
(2005) or Amit, Grenander and Piccioni (1991), shape analysis in Kendall et al. 
(1999), Grenander (1994) or Huckemann, Hotz and Munk (2010), with many 
applications ranging from biology in Bolstad et al. (2003) to pattern recogni¬ 
tion Sakoe and Chiba (1978) just to name a few. 

The same kind of issues arises when considering the estimation of distribution 
functions observed with deformations. This situation occurs often in biology, for 
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example when considering gene expression. However, when dealing with the reg¬ 
istration of warped distributions, the literature is scarce. We mention here the 
method provided for biological computational issues known as quantile normal¬ 
ization in Bolstad et al. (2003) and the related work Gallon, Loubes and Maza 
(2013). Very recently using optimal transport methodologies, comparisons of 
distributions have been studied using a notion of Frechet mean for distribu¬ 
tions, see for instance in Agueh and Carlier (2011) or a notion of depth as in 
Chernozhukov et al. (2014). 

Actually the observations are said to come from a deformation model if they 
can be written as 

for j = 1,..., J where (e^j ) defined for all 1 ^ ^ n, 1 ^ j ^ J are i.i.d. ran¬ 

dom variables with unknown distribution /r and for deformation functions (p*. 

This model is the natural extension of the functional deformation models stud¬ 
ied in the statistical literature for which estimation procedures are provided in 
Gamboa, Loubes and Maza (2007) while testing issues are tackled in Collier and Dalalyan 
(2015). Within this framework, statistical inference on deformation models for 
distributions have been studied first in Czado and Munk (1998), Munk and Czado 
(1998) and Freitag and Munk (2005), where tests are provided in the case of 
parametric functions, while the estimation of the parameters is studied in Agullo-Antolfn et al. 
(2015). 

In this work, after recalling the model we use in Section 2, we tackle the 
problem of providing a goodness of fit test in a general non parametric defor¬ 
mation model. For this, we will use an alignment criterion with respect to the 
Wasserstein’s barycenter of a deformation of the observed distributions. This 
requires an equivalent of a central limit theorem for the Wasserstein variation 
of a barycenter of measures in both the general case in Section 3 and under 
the null assumption (observations are drawn from the deformation model) in 
Section 4. We obtain the asymptotic distribution of the matching criterion in 
both cases, with a different normalization under the null assumption (only for 
the parametric case). For this, we will need to build estimates of the deforma¬ 
tion parameters with respect to this particular alignment criterion and study 
their behavior in Section 4.1. Finally testing procedures are given in Section 5. 

They rely on the estimation of the quantiles of the empirical process of the 
Wasserstein’s variation which is obtained using a bootstrap procedure proved 
in Section 5.1. Proofs are postponed to Section 6. 

2. A deformation model for distributions 

Assume we observe J samples of n i.i.d random variables j with distribution 
fij, associated to a distribution function Fj : (cj,dj) i-->- (0,1) with density with 
respect to the Lebesgue measure fj. Let and Fnj be the empirical measure 
and empirical distribution function associated to the sample (-^i,j)i<i<„- 

Our aim is to test the existence of a distribution’s deformation model, in the 
sense that all the distributions pj would be warped from an unknown distribu- 
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tion template ^ by a deformation function ip*. More precisely, consider a family 
of warping functions Q — Qi ■ ■ ■ y~ Qj such that 

For all S C/j ,ig invertible, increasing, (-41) 

X I—^ tl 

and s.t. — 00 ^ a < 6 ^ +oo, —oo ^c^Cj<dj^d^ +oo. 

We would like to build a goodness-of-fit testing procedure for the following 
model 


There exist ... (/?j) G G and (ci i-i-d. such that 

W,, = ((p*) ■'(£,.,) (H) 

Denote by G the distribution function of e with law p with support (a, b), while 
Gn,j is the corresponding empirical version. 

Our criterion will be based on the Wasserstein distance bF| since this dis¬ 
tance is well suited to compared deformations between distributions. For d ^ 1, 
consider the following set 

W 2 (K^^) = {P probability on with finite second moment} . 

For two probabilities /r and i/ in >V 2 , we denote by n(/r, ly) the set of 

all probability measures tt over the product set x with first (resp. second) 
marginal p (resp. v). 

The transportation cost with quadratic cost function, or quadratic trans¬ 
portation cost, between these two measures /i and u is defined as 


7^(/r,i/)= iiif [ \\x-yf dn{x,y). 

The quadratic transportation cost allows to endow the set W 2 with a 
metric by defining the 2-Wasserstein distance between p, and 1 / as W 2 {p,i') = 
72(^1 ■ More details on Wasserstein distances and their links with optimal 

transport problems can be found in Rachev (1984) or Villani (2009) for instance. 

Here we will consider probabilities in >V 2 (R). In this case, the Wasserstein 
distance can be written as 

W| (/i, v) = (F-^ (t) - G-i (<))"*, (1) 

do 


where F (resp. G) is the distribution function associated with y (resp. v). 

Moreover, we are dealing with more than two probabilities and so we are 
interested in a global measure of separation. So consider the Wasserstein 2- 
variation of vi,... ,vj, defined as follows. Given probabilities ... ,iyj on R"^ 
with finite 2-th moment let 


V ( 1 ^ 1 , ...,iyj) 


be the Wasserstein 2-variation of z/i,..., vj. In Agueh and Carlier (2011), the 
minimizer of 771 —>■ -j v) is proved to exist. This measure vb is called 

the barycenter or Frechet mean of , z/j. The authors prove properties of 

existence and uniqueness for barycentres of measures in W 2 (K'^), while the prop¬ 
erties of the empirical version are provided in Boissard, Le Gouic and Loubes 
(2015). 

We propose to use this Wasserstein 2-variation as a goodness of fit criterion 
for model {'H). Since the true distribution /r is unknown, we first try to invert 
the warping operator and thus compute for each observation its image through 
a candidate deformation ipj, 

f ^ ^ ^ ^ ^ j ^ J- 

Note that Zij {ipj) with distribution function (under Assumption Al) 

Fj o := F^p.. Now, if we set (/? = (v?i,..., (fj) G Q, then the Frechet mean 
of is the probability with quantile function 

= F^^ {t ), 

k=l 

(see Agueh and Carlier (2011)). We will write for the empirical measure 

on Zij{ipj), 1 < i < n and for the corresponding Frechet mean. It is 

important to remark that 

under {H) VI < j ^ J. 

Hence, a natural idea to test whether T-L holds, is to consider the Wasserstein 2- 
variation of the , 1 ^ j ^ J, that is to say the minimum alignment of the 

candidate warped distributions with respect to their barycenter, 

namely p-s (</?). This optimization program corresponds to the minimization in 
(fi G G oi the following theoretical criterion 


Its empirical version is given by Uni^p) = Pn,B{‘p))- Inference 

about model % can be based on the statistic inf,^gg Un {p)- In the next sections 
we analyse the behavior of this statistics under different setups. 

3. Non parametric model for deformations 

We provide in the section a CLT for inf^^gp Un (p) under the following set of 
assumptions. 

For all j, Fj is on {cj;dj), fjix) > 0 if a: G {cj]dj) and (-42) 
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sup 

Cj<.X<. dj 


Fj{x){l-Fj{x))f’j{x) 

fj 


< OO. 


For some q > I and all 1 ^ j ^ J, jy^^;^T^yjyrdt < +oo (-^3) 

For q as in ^3, we set po = max 2^ and define on 'Hj = C^{cj-,dj) fl 
(Xj) the norm ||hj||^^ = sup(g^.^^.) |/i'| +E [\hj (Xj)|^“]po , and on the prod¬ 
uct space 'Hi X • • • X Hj, ||h||^ = X]/=i ll^ill-H • make the following 

additional assumptions. 


CZ compuct for II ■ llwj and 


sup 

h^Qj suPheSj 


for some r > 4 and 1 ^ j ^ J, E [|Xjr] < oo 


0 . 

(-44) 

(-45) 


for some r > max(4,po) and 1 ^ j ^ J, 


E 


sup i/i(Xj)r 

heOj 


< oo 


(-46) 


Under Al to .46, we are able to provide the asymptotic distribution of 
inf,^gg ^JnUn{q^)- It is convenient at this point to give some explanation about 
the meaning of these assumptions. A2 is a is a regularity condition on the distri¬ 
butions of the X'jS (it holds, for instance, for Gaussian or Pareto distributions) 
required for strong approximation of the quantile process, see Csorgo (1983) for 
details. The integrability condition is satisfied by the Gaussian distribution 
if g < 2, see, e.g., Rajput (1972). 4l4 is related to the regularity of the deforma¬ 
tion functions. Finally, .45 and .46 are moment assumptions on the (possibly 
warped) observations. 


Theorem 3.1. Under Assumptions Al to 4l6 


\/n( inf UniqA — inf 



of: 


B, 




3t(h 


3 O Pj 


Fb\V>)). 


where F = {(p S t/ : U{lp) = inf^gp t/(</))} and {Bj)^^-^j are independent 
Brownian bridges. 


A proof of Theorem 3.1 is given in the Appendix below. We note that con¬ 
tinuity of U is follows easily from the choice of the norm on Q. Recall that Q 
is compact and, consecuently, infc^gg U{ip) is attained. Hence, F is a nonempty 
closed subset of Q (in particular, it is also a compact set). We note further 
that the random variables /„ tp' o F~^ {(pj o F~^ — F^^{(p)) are centered 
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Gaussian, with covariance 


I[o i(t)) - Fgi((^)(t)) 

X - F^^{ip){s))dsdt. 

In particular, if U has a unique minimizer the limiting distribution in Theo¬ 
rem 3.1 is normal. However, our result works in more generality, even without 
uniqueness assumptions. 

We remark also that although we have focused for simplicity on the case of 
samples of equal size, the case of different sample sizes, rij, j = 1,..., J, can 
also be handled with straightforward changes. If we assume 

Vj : rij —>• - 1-00 and - — -( 7 ,)^ > 0, (2) 

ui -I- +nj 

then the result can be restated as 

.. ^ 

where Um,...,nj denotes the empirical Wasserstein variation computed from the 
samples and Sj{ip) = (Hp^^qp) ip'- o f {pj o - Fg^{p)). 

As a final remark in this section we note that in the case where Ti. holds, 
we have pj o F~^ = Fg^ipp) for each 75 G T. Thus, the result of Theorem 3.1 
becomes 

inf \/nUn{p) 0 . 

Hence, in this case we have to refine our study to understand well the behavior 
of infg Un when n tends to infinity. This is what we consider in the next section. 
In this case we restrict ourselves to a to a semiparametric warping model where 
p is unknown but where the deformations are indexed by a parametric family. 

4. A parametric model for deformations 

In many cases, deformation functions can be made more specific in the sense 
that they follow a known shape depending on parameters that are different for 
each sample. So consider the parametric model 9* = {9\,... ,6j) such that p* = 
pe *, for all j = 1,..., J. Each 6* represents the warping effect that undergoes 
the sample, which must be removed to recover the unknown distribution by 
inverting the warping operator. So Assumption % becomes 

Xip = pZ} (ei,j), for all 1 < i ^ n, 1 ^ j ^ J. 

’ ^3 ’ 

Hence, from now on, we will consider the following family of deformations, 
indexed by a parameter A G A C 

7 ) : A X (c; d) —>■ (a, b) 

(A,x) pa(x) 
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Thus, the functions U and C/„ are now defined on 0 = A'^, and the criterion 
of interest becomes infAgef7(A). We also use the simplified notation Hj{0j) 
instead of {Lpg .), Fb (d) for Fb (</56»i , ■ • ■ > ‘POj ) and similarly for the empirical 
versions. Throughout this section we assume that model T-L holds. This means, 
in particular, that the d.f.’s of the samples, Fj, satisfy Fj = Goipg^ with G the 
d.f. of the ei,j’s. 

For the analysis of this setup, we adapt Assumptions Al to A6, replacing 
them by the following versions. 


11 X A (c; (a; 6) . . , .1 1 . 

for all A G A, (/3 a : / \ is invertible, increasing, 

X (x) 

and s.t. — oo ^ a < b ^ +c», —c» ^c^Cj<dj^d^ +c». 

We replace A2 by: G is with G'{x) = g{x) > 0 on (a, h) and 

G{x) {I - G{x)) g'{x) ^ 
a<x<b yy.'^) 

Now, instead of Al3 to Al5 we assume 

(/9 is continuous w.r.t. x and A 
VA G A, ip\ is G^ with respect to x, A is compact 


(Al) 


(A2) 


(A3) 


dip is bounded 

and sup \dpx 
AgA 


on A X [cj] dj] and continuous with respect to A 


(iCn) - dpx ( x ) 




> 0 . 


(A4) 


VI ^ j ^ J E [|A_/|^] < oo for some r > 4 (AS) 

Here d is the derivation operator w.r.t. x, while d will be the derivation operator 
w.r.t. A. Finally A6 becomes 


VI ^ j J 


E 


sup \px (Aj)f 
.AgA 


< oo for some r > 4 


(A6) 


Note that Assumption A6 implies that e has a moment of order r > 4 and also 
that Assumption A3 becomes simpler in a parametric model which does not 
require a particular topology. 

We impose as identifiability condition, 


U has a unique minimizer, 9*, that belongs to the interior of A. (A7) 


Note that, equivalently, this means that 9* is the unique zero of U, since we are 
assuming that H holds. 

Now, to get sharper result about the convergence of infgge {7" (0), one has 
to add the following assumptions, first on the deformation functions. 

VI ^ < J Pg} is G^ w.r.t. X and dpi} is bounded on [a, b] (AS) 

^3 ^3 

p is (7^ w.r.t. X and A 
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< oo 


(A9) 


VI < j < J 


E 


sup 

.AeA 


d'^ipx 



As said for Assumption A3, the following one is more restrictive on the tail 
of the distribution of e, excluding the Gaussian case. Examples of such variables 
with unbounded support are given in del Barrio, Deheuvels and van de Geer 
(2007) p.76. Note that distributions with compact support and strictly posi¬ 
tive, continuous density satisfy this assumption. 


9HG-Ht)) 


dt < oo 


(AlO) 


4 . 1 . Estimation of the deformation model 


Set 


0" G argminC/"(6l). 

eee 


The results in this section are stated in the case where A is a subset of 
R. However they are still true if A C with corresponding changes. The 
following result implies that 0" is a good candidate to estimate 9*. It is a simple 
consecuence of continuity of U plus uniform convergence in probability of to 
U, as shown in the proof of Theorem 3.1. We omit details. 


Proposition 4.1. Under A1 to AT, then 


Qu 0 * probability. 


We can refine this result by making the following additional assumption, 

Rj := dife* o ipTf is continuous and bounded on [a, b], 1 < j < J. (TCL) 

Define now $ = j with 

2 2(J — ll 

‘f’ij' = ^i,i = -J2 (3) 

where H-H^ and denote norm and inner product, respectively, in L^(/r). $ 

is a symmetric, positive semidefinite matrix. To see this, consider x G and 
note that 


x'^x 


72 / 

i i<j 

J '^{xtRi - XjRjfdpi > 0 . 


In fact, $ is positive definite, hence invertible, unless all the Ri are proportional 
/i-a.s.. Now, we have the following Gentral limit Theorem, which is proved in 
the Appendix. 








Proposition 4.2. Under Assumptions A1 to A9 and TCL, if, in addition, $ 
is invertible, then 

- r) ^ 

where Y = (Yi,..., Yj) with 




RjoG-^ 


B, 

50G-1’ 


Bj = Bj — j X]fe=i Bk o-nd {Bj)^^-^j independent Brownian bridges. 

We note that, while, for simplicity, we have formulated Proposition 4.1 as¬ 
suming that the deformation model holds, a similar version can be proved (with 
some additional assumptions and changes in $) in the case when the model is 
false and 0 * is not the true parameter, but the one that gives the best (but 
imperfect) alignment. 


Remark 1. The indentifiability condition A7 can be too strong to be realis¬ 
tic. Actually, for some deformation models it could happen that ipg o (fri = <pe*ri 
for some 9 * rj G 0. In this case, if Xij = with Sij i.i.d., then, for 

any 9, Xij = with Sij = (pe{eij) which are also i.i.d. and, conse- 

quently, {9 * 0^,... ,0 * 9j) is also a zero of U. This applies, for instance, to 
location and scale models. A simple fix to this issue is to select one of the 
signals as the reference, say the J-th signal, and assume that 9j is known 
(since it can be, in fact, chosen arbitrarily). The criterion function becomes 
then U(9i ,..., 9j-i) = U{9i,..., 9j-i, 9*j). One could then make the (more re¬ 
alistic) assumption that 0* = (91,..., 9*j_i) is the unique zero ofU and base the 

analysis on Un{0i, •. •, 0j-i) = t/„(0 i,..., 0j-i,0j) and 0^ = argmin^ Un(0). 
The results in this section can be adapted almost verbatim to this setup. Propo¬ 
sition 4.2 holds, namely, y/n{0'^ — 9*) with Y = (Yi,..., Yj_i) and 

We note further that invertibility of $ is almost granted. 
In fact, arguing as above, we see that 


x'^x = 


2 

J2 


(xiRi — XjRj)'^-I xfRf^dpL>G 


and $ is positive definite unless Ri = 0 fx-c.s. for i = 1,..., J — 1. 


4 . 2 . Asymptotic behavior of Wasserstein’s variation under the null 


Here we are able to specify the speed of convergence of infgge (0) to zero 
when R holds, providing the asymptotic distribution of this statistic. 

Theorem 4.3. Under assumptions A1 to AlO, TCL and invertibility of^. 


n inf Un{ 9 ) 
eee 


1 

J 



Bj 

goG-^ 


) 


2 


Iy'^-^y 

2 
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with y = (Fi,..., Yj), Y, = 1 /o' R, o G-i^, B, = - i ELi Bk and 

(Bj)icj^j independent Brownian bridges. 

A proof of Theorem 4.3 is given in the Appendix. As for Theorem 3.1, this 
result can be generalized to the case of different sample sizes with straightfor¬ 
ward changes. We also note that the result can also be adapted to the setup of 
Remark 1, replacing the correction term ■^Y'^~^Y by ^Y'^~^Y. 

Turning back to our goal of assessment of the deformation model T-L based 
on the observed value of infege t/" (0), Theorem 4.3 gives some insight into 
the threshold levels for rejection of TL. However, the limiting distribution still 
depends on unknown objects and designing a tractable test requires to estimate 
the quantiles of this distribution. This will be achieved in the next section. 

5. Testing procedure with Wasserstein distance 
5.1. Bootstrap with Wasserstein distance 

In this section we present general results on Wasserstein distances that we will 
apply to estimate the asymptotic distribution of a statistic test based on an 
alignment with respect to the Wasserstein’s barycenter. More precisely, here we 
consider distributions on with a moment of order r ^ 1, that is, distributions 
in Wr ■ Wr will denote Wasserstein distance with Lr cost, namely, 

W;(iy,p)= inf f lly-zlj’'dTr(y,z), 

where H-H is any norm on Finally, we write C{Z) for the law of any random 
variable Z. We note the abuse of notation in the following, in which Wr is used 
both for Wasserstein distance on R and on R'^, but this should not cause much 
confusion. 

The next result shows that the laws of empirical transportation costs are 
continuous (and even Lipschitz) functions of the underlying distributions. 

Proposition 5.1. Set n, iz', rj probability measures in Wr (R'^), W, ■ ■ ■ ,Yn i-i-d. 
random vectors with common law v, Y(,... WnJ i-i-d. with law v' and write Vn, 
for the corresponding empirical measures. Then 

WriC(WriVn,V))XiWriVn,r]))) ^ Wriv,v'). 

Our deformation assessment criterion concerns a particular version of the 
Wasserstein r-variation of distributions i/i,... ,i/j in Wr (R'^), that we will de¬ 
note in its general form by 


VrilZl, 


inf 

rieWr(B 


J 






i=i 


l/r 


Vr is just the average distance to the r-barycenter of the set. 
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It is convenient to note that {vi,... ^vj) can also be expressed as 

V^{ui,...,vj)= inf f T{yi,...,yj)dTr{yi,...,yj), (4) 

where n(i/i,..., i/j) denotes the set of probability measures on with marginals 
and T{yi, ...,yj) = min^gRd j J2j=i WVj “ AV ■ A discussion about 
this formulation for r = 2 and a result on existence and uniqueness of a mini- 
mizer in problem (4) are given in Proposition 4.2 in Agueh and Carlier (2011). 

Here we are interested in empirical Wasserstein r-variations, namely, the r- 
variations computed from the empirical measures v'nj j coming from independent 
samples Yij, ..., Yn^j of i.i.d. random variables with distribution Vj. Note that 
in this case problem (4) is a linear optimisation problem for which a minimizer 
always exists. 

As before, we consider the continuity of the law of empirical Wasserstein r- 
variations with respect to the underlying probabilities. This is covered in the 
next result. 


Proposition 5.2. With the above notation 


W:{C{Vr{Vn,A, . ■ . .V^j,j)),C{VrK 


m ,1 ’ • ■ • ’ ^nj 


t=i 


A useful consequence of the above results is that empirical Wasserstein dis¬ 
tances or r-variations can be bootstrapped under rather general conditions. To 
be more precise, we take in Proposition 5.1 v' = Vn, the empirical measure on 
Yi,... ,Yn and consider a bootstrap sample Y*,, Y^^ of i.i.d. (conditionally 
given Yi,..., y^) observations with common law v^. We write for the em¬ 
pirical measure on Y,*,... ,Y^ and C*{Z) for the conditional law of Z given 
Yi,..., Y„. Proposition 5.1 now reads 


Wr{C*{Wr{vl^^,v)),C{Wr{Vm^,v))) ^ Wri^nW)- 

Hence, if Wri^n, v) = Op(l/rji) for some sequence > 0 such that t 0 

as n —>■ oo, then, using that Wr[C{aX), C{aY)) = aWr{C{X),C{Y)) for a > 0, 
we see that 

Wr{C*{rm^Wr{v'^^,v)),C{rjn,^Wr{Vra^,v))) < ^^r„HA (z^„, :/) -)> 0 (5) 

Tn 

in probability. 


If in addition r„lYr(r'n, v) ^ ^ {v) for a distribution 7 (v) then 

rm^WriVm^,v) 'y{v) 

which entails that if c„(a) denotes the a quantile of the conditional law C* (rm„ Wr{v '^^, v)) 
then under some regularity conditions on the distribution 7 ( 1 ^) 


V i'l’nWrivnW) ^ Cn{a)) ^ a asn—>- 00 . 
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(6) 


We conclude in this case that the quantiles of v) can be consistently es¬ 

timated by the bootstrap quantiles, that is, the conditional quantiles of 
(which, in turn, can be approximated through Monte-Carlo simulation). 

As an example, if d = 1 and r = 2, under integrability and smoothness assump- 

tions on v we have \/nW 2 {vn, ^ Jq dt'j , where / and F~^ are 

the density and the quantile function of ly. 

5.2. Bootstrap for Wasserstein’s barycenter alignement 

In the non parametric deformation model, statistical inference is based on the 
minimal Wasserstein variation 

vl := inf =infI/„, 

Q 

where Unji^p) denotes the empirical measure on ^ Znjif), where 

Zij[tp) = and Xi^,... ,Xnj are independent i.i.d. samples from gj. 

Consider v'„ , the corresponding version obtained from samples with underlying 
distributions /r)-, and denote by C{vn) (reps. C(v!^)) the law of the random 
variable Vn (resp. v'^). 

Then, the following result holds, setting = supx^{cj-,dj) \‘Pjix)\- 

Theorem 5.3. Under Assumption Al , if for all j Qj C (cj;dj) and sup^^g ||</5j|| < 

00 , then 

W^(£(Vn),£(v'J) ^ sup 

‘peg a 

Now consider bootstrap samples X^ j,... ,X^^ j of i.i.d. observations sam¬ 
pled from Pn,j-, write j for the empirical measure on Xf j ,..., X^^ j (condi¬ 
tionally to the Xij,..., and denote (</?)■ 

Then we get 

Corollary 5.4. If rUn —>■ oo, and mnjy/n — > 0, then under Assumptions Al to 
A6, and ifinigU > 0, writing 7 for the limit distribution in Theorem 3.1, we 
have that 



in probability. In particular, if Cn{a) denotes the conditional (given the Xij’s) 
a-quantile of y/mn (infg ~ then 

(7) 

Now consider the parametric deformation model and note that the inference 
about it is based on the minimal Wasserstein variation 

vl := ini ■■■, Tn,j{0)) =infC/„, 

crGtv fc) 
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where Hn,j{d) denotes the empirical measure on Zij{0 )^..., Znj{9), ZijiO) = 
and Xi^j,..., Xnj are independent i.i.d. samples from fij. We consider 
v'^, the corresponding version obtained from samples with underlying distribu¬ 
tions /i', and denote by C (u„) (resp. C (u^)) the law of the random variable Vn 
(resp. v'J. 

Then, we are able to prove the following result. 

Theorem 5.5. Under Assumptions Al, A3 and A4 

1 

Wimvn),C{v'J) ^ sup \dipx{x)\^ 

x^{c‘,d),X^A 

Now consider bootstrap samples ... ,X^^ j of i.i.d. observations sam¬ 
pled from /r", write j for the empirical measure on Xi j ,..., X^^ ^ (condi¬ 
tionally to the .. .,Xnj) and denote VAd*m^,i{0), ■ ■ ■, tJ*m^,jiP)) = (^)- 

Corollary 5.6. If rrin —>■ oo, and mn/n —>■ 0, then under Assumptions Al to 
AlO, TCL and writing ^(G',9*) for the limit distribution in Theorem 4-3, we 
have that 

C* (m„infl7;;„) -7(G;r) 

in probability. In particular, if Cniot) denotes the conditional (given the Xij’s) 
a-quantile ofmn infe then if the quantile function of ^ (G; 9*) is continuous 
w.r.t a 

P ^ninf C/" < Cn{a)j —>■ a. (8) 


5. 3. Goodness of fit 

In the semi parametric model, we can now provide a goodness of ht procedure. 
Under Assumptions of Theorem 4.3 (Al to AlO and TCL) one can test the 
null assumption 

inf U{9) = 0 (Ho) 

See 

versus its complementary denoted by Hi- 

In this case the test statistic is n infe Un and one can get the asymptotic level 
of a reject region of the form {ninfe Un > A„} by using Corollary 5.6. 

More precisely, consider bootstrap samples X^^,... j of i.i.d. obser¬ 

vations sampled from pin,j, and write (9) for the corresponding criterion. 
Then, if Cn{a) denotes the conditional (given the Xi^'s) (1 — a)-quantile of 
TOn infe 

P ^ in^Un{9) > c„(a)^ —>■ a. 

Thus {ninfege Un{9) > c„(a)} will be a reject region of asymptotic level a, 
and Cn{oL) can be computed using a Monte-Carlo method. 
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Note that in the case of a non parametric model, a test can be designed 
switching the null hypothesis. Hence set for Aq > 0 set 

infl7 = Ao {HD 

y 

inft/<Ao {H\) 

0 

The test statistic in this case is (Aq) := y/ri{inig [/„ — Aq). Then, under 
assumptions of Corollary 5.4 („4l to .46), if Cn{a) denotes the conditional (given 
the Aij’s) Qf-quantile of the bootstrap version y/uin (infg — Aq), under Hq 

P {Un (Ao) ^ Cn{a)) a, 

which gives the asymptotic level of the reject region {Un (Aq) ^ c„(a)}, where 
Cn(a) can be computed using a Monte-Carlo method. 

This procedure can be made more precise under Assumptions of Theorem 
3.1 in the parametric case (A1 to A6). Set for 1 ^ j ^ J, set Sj (0) = 

fo (^)) f,{Fp{t)) independent centered 

Gaussian variables. Then the result of Theorem 3.1 can be restated as 



\/n \ inf Un — 
1 e 

inf C/| 
e J 

j=l 


Let (t| 

the variance of Sj{9*)- Set 

^ L, a 

■) = 


EL2 ( 


(r) 

( 0 ")) Then 

we could prove 

that 



n 1 ^ 

a)- 

y j 0 N ' 





k^i 



converges in probability to tT|. Hence, we can now provide a test procedure for 
the null assumption 

inf[/>Ao {Hi) 

versus its complementary denoted by H\. 

Here we set the test statistic as V„ (Aq) := . Then 

^infe t7„ - infe H ^infe 17 - Aq 
Vn (Aq) = Vn-::-h Vn-;;- 

O'n 

and if infe U = Aq 

V„(Ao) -Z^AA(0,1) 

else, if infe U > Aq, we get that for all m S R 


P(V„ (Aq) ^ m) 1. 
14 







Then, 


sup lim P {Vn (Ao) ^ A) ^ $ (A) 

s.t. (Hg) holds 

where $ is the distribution function of the standard normal distribution. Thus 
we can construct a test of asymptotic level a by choosing the reject region 


6. Appendix 


We provide here proofs of the main results in this paper. For those in Sections 
3 and 4 our approach relies on the consideration of quantile processes, namely, 

Pn,j{t) = Vnfj{F-^{t)){F-]{t) - F-^{t)), 0 < j < 1, j = 1,..., J, 

and on strong approximations of quantile processes, as in the following result 
that we adapt from Csorgd and Horvath (1993) (Theorem 2.1, p. 381 there). 

Theorem 6.1. Under A2, there exist, on a rich enough probability space, in- 
ependent versions of pn,j and independent families of Brownian bridges {Bnj}n=iOO, 
j = satisfying 

1 / 2 -^ \Pn,jit) - Bnj{t)\ _ f Op(log(n)) if ly = 0 

l/n^J-l/r. m - t)r 1 Op(l) */0 < 1. ^ 1/2 


We will make frequent use in this section of the following technical Lemma 
which generalizes a result in Alvarez-Esteban et al. (2008). 

Lemma 6.2. Under Assumption A6 

i) supftgp^ y/fij^{h{F-^{t))fdt 0, sup;,gp. y/njl_^{h{F-^{t))fdt 0. 

sup,,gg. ^/n {h{F-j{t)))^dt 0, sup^gg. J^_±ihiF-j{t)))^dt 0 

in probability, 
in) If moreover A3 holds 

'^k,j f sup \ipj (F~^ (f)) - Ff)^ (p) it)\dt<oo (9) 

Jo Jk (F^ (c)j ipeC? 

iv) In the parametric case, under Assumptions A3, A6 and if'ik, Fk is 
with Fl = fk > Q on {ck,dk) 


yk,j 


h {Fk\t)) 


sup 

9^0 


< (F-^t)) - F-^ (9) it) 


dt < oo 


( 10 ) 


Our next proof is inspired by Alvarez-Esteban et al. (2008). The main part 
concerns the study of y/nUnigA) uniformly in g> in probability by using strong 
approximations of the quantile process with Brownian bridges. 
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Proof of Theorem 3.1. We will work with the versions of and Bnj 
given by Theorem 6.1. We show first that 



with = 2 if j o o Fj ^ - Fg^{ip)) ■ To check this we 

note that the fact that j J2j=i ‘Pj ° simple algebra yield 

Vn{Un{(p) - U{ip)) = f J2j=l Sn,j + 7 Ei=l Rn ,3 with 

Sn ,3 =Vn [ {(fij O F-j - ipj o F-^){ipj o F-^ - F^^ip)), 

Jo 

Rnj = Vn [ [{ipj o F-] - ipj o F-i) - (F-]j(vj) - 
Jo 

From the elementary inequality (ai + • • • + aj)^ < Ja\ + • • • + Joj we get that 


1 

X/ - 





Now, for every t G (0,1) we have 

Pj ° Fn,j{t) - Pj ° F^\t) = P'jiKn,^. mF-]{t) - F-\t)) (12) 

for some Kn,cfij{t) between F~j{t) and F~^{t). Assumption A4 implies Cj := 
\p'i{x)\ < oo. Hence, we have 







Now we can use A5 and argue as in the proof of Theorem 2 in Alvarez-Esteban et al. 
(2008) to conclude that ^/n /Q^(F'“j — T“^)^ —>■ 0 in probability and, as a con¬ 
sequence, that 


sup 


Vn {Un {<p) - U {(fi)) - j 


1=1 


—1 0 in probability. (13) 


On the other hand, the Cauchy-Schwarz’s inequality shows that 
{Pj ° F-] - ifij o F-^){^pj o F-^ - Fg^{ip) 


< Vn I {iPj o j - (fij o F^ I {(fij oF^^ - Fg\ip)f 


16 








and using i) and ii) of Lemma 6.2, the two factors converge to zero uniformly in 
ip. A similar argument works for the upper tail and allows to conclude that we 

can replace in ( 13) Sn,j {p) with Sn,j{p) '■= ‘2y/n fl " (pj o F~j - pj oF~^){pj o 
F~^ — Fg^{p)). Moreover, 


sup 


p\ o f: 


< Q 






o F-^ - F^\p)) 
B. 






-1 


sup\{pjoF. -Fg (v?))! 




and by iii) of Lemma 6.2 and Cauchy-Schwarz’s inequality 


E 

[/' 

Bn,j 
/. ^ 1 

sup ((^J oF. 1 - Fj^\p))\ 



o 

- 

peg -I 


- / //l-i/ll Wi^Pj ~ PB^{^)iP)\dt 0- 

h fjiFj it)) peg' 


Hence, sup^gg f- pt oF^ ^(p^ °Pj^-Pb^ 


—^ 0 in probability and 


similarly for the right tail. Thus (recall (12)), to prove (11) it suffices to show 
that 


sup 

peg 


'' \'JF-\t))-^^:^ip,iF-\t))-F^\p)it))dt (14) 


fjiF-\t)) 


r-l-- 


p'jiKn,p,it)) (v?j(J;- ^it)) - Fg\p){t))dt 

(tj) 


in probability. To check it we take G (0,1/2) and use Theorem 6.1 to get 


IPnjjt) Bnjit)\ 
fjiF-\t)) 


sup \pjiF^ ^{t)) - Fg^{p){t)\dt 
peg 


< 



sup \pjiF^ \t)) - Fg\p)it)\dt 0 
it)) peg' 

(15) 


in probability (using dominated convergence and iii) of Lemma 6.2). 

We observe next that, for all t G (0,1), sup,^^.gg^. \Kn^y,^it) — F~^it)\ —>■ 0 
almost surely, since Kn^^-it) lies between F~jit) and F~^it). Therefore, using 
Assumption A4 we see that sup,^^gg^ (Ar„^^^. (t)) — i^'(F“^(t)| —^ 0 almost 
surely while, on the other hand sup,^^gg^ Ip^iKn^ip^it)) — PjiF~^it))\ < 2Cj. 
But then, by dominated convergence we get that 


E 


sup 

ipj G Qj 


|^'(F„_(t))-^'(F-i(t))p 


^ 0 . 
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Since by iii) of Lemma 6.2 we have that t !->• sup gc ^{t)) — 

Fq is integrable we conclude that 

Esup f |yj-(e~\t)) - Fg^{lf){t)\dt 

veeii Jj[^j [t)) 

tends to 0 as n —>■ oo and, consequently, 
sup f \(p'j{Kn,^.{t)) - (p'j{F-^{t))\ - Fg^{ip){t)\dt 

¥>66 di Jj{tj it)) 

vanishes in probability. Combining this fact with (15) we prove (14) and, as a 
consequence, (11). 

Observe now that for all n G N, {Sn,j{‘p))i^j^j has the same law as {Sj {‘p))i<cj<j 
with ^ 

S,{^) =2 [ o o F-^ - F^\^)) 

Jo Jj ° J'j 

and independent standard Brownian bridges. Set S = L Sj. 

Now, (11) implies that 

^([/"(.)-C/(.)) ^ 5 (.) (16) 

in the space L°° (Q) (we denote by IHl^ the norm on this space). From Sko- 
horod Theorem we know that there exists some probability space on which the 
convergence (16) holds almost surely. From now on, we place us on this space. 
Then, for ip, p € G 


|5'j(‘/5) - 5'i(p)| < 2 sup - p' 

{cj,dj ) 

rl 




lo fjoF: 


— iV’joFj -Fb (p)) 


+2 


B 


^—p',oF-\p,oF-^-p,oF-^) 


lo fjoF^ 

< 2 sup |(p' - p' I sup [ (pj °Fj~^ - Fb\p)) 

{c,.dA veG Jo fioF, 


B. 


>0 fj - 

,1/9, 


+2 sup Ip'I (/o'I I") \jo\PjoF^ ^-PjoF^ 1^) 


l/po 


(cj,dj) 

But using iii) of Lemma 6.2 


E 


sup 

L 


B, 


€ 


0 fj°F- 


-{^^oF-^-Fb^{p)) 


lo fk{F,-\t));7G 


sup |(pj (F^ ' (t)) — Fg^ (<p) (t)| dt < oo 
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< cw. Furthermore, 


Hence, almost surely, sup^^gp ^ 

Jj ^ j 

from Assumption A3, we get that a.s. 




{‘P)) 



< oo 


and thus, for some random variable T a.s. finite , and ip, p £ Q, we get 


\Sj (p) - Sj {p)\ ^r|i(p-p||g. 


Thus, we deduce that are almost surely continuous functions on Q, 

endowed with the norm Il’Hg. 

Observe now that 


•v/n^ inf {7„ — inf < ^/n inf Un — \fn inf C7 = inf yjn (Un — U). (17) 


On the other hand, if we consider the (a.s.) compact set Tn = {ip G G '■ U {ip) ^ 
infp U \\y/ri {Un - then, ii ip ^ F", 

Un {ip) > inf [/ + 2 ||(t7„ - U)\\^ - \\{Un - t/)IL , 

y 


which implies 

C/„(v.)^infC/+||([/„-[/)||^, 

y 

while if (/? G r, then. 


Un {^) =miU + [/" {p) -U{p)^ inf U + ||{Un - U)\\^ . 

y y 

Thus, necessarily, infg 17„ = infr„ Un = infr„(17ji — U + U) > infr^(17„ — U) + 
infr„ U = infr„({7ji — U) + infp U. Together with (17) this entails 

inf y/n{Un — U)i^ y/n{ mi Un — inf U) < inf ^/n {Un — U). (18) 

Note that for the versions that we are considering \\y/n{Un — U) — ^Hoo —t 0 
a.s.. In particular, this implies that infr \/n{Un — [/)—?> infr S a.s.. Hence, the 
proof will be complete if we show that a.s. 

inf ^/n {Un — U) ^ inf S. (19) 

Tn r 


To check this last point, consider a sequence ipn G r„ such that •\/n{Un{ipn) — 
U{ipn)) < infr„ y/n{Un ~ + ^- By compactness of G, taking subsequences if 

necessary, ipn ipQ for some G- Continuity of U yields U{ipn) —>■ U{ipQ) and as 
a consequence, that U{ipQ) < infg U, that is, (/jq G F a.s.. Furthermore, 

\V^{Un-U){ipn)-S{po)\ 

< \\'/n{Un -U)- S'll^ + IS” {ipn) - S (vJo)l ^ 0. 
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This shows that 


liminf inf y/n ([/„ — U) > S (ipo) ^ inf S 


( 20 ) 


and yields (19). This completes the proof. 


□ 


Proof of Proposition 4.2. We denote by dj the derivative operator w.r.t. 
9j, 1 ^ j ^ J and dj^k for second order partial derivatives. We note that TL 
entails that the empirical d.f. on the j-th sample, Fn,j{t), satisfies Fn,j{t) = 
(t)) with Gnj the empirical d.f. on the (which are i.i.d. p, with 

d.f. G). We write now pnj for the quantile process based on the Sij^s. We write 
Bnj for independent Brownian bridges as given by Theorem 6.1 (observe that 
(A2) grants the existence of such Bnj’s). 

Assumption TCL implies that dipg* G L^(Xj). Moreover, with Assumptions 
A8, A9 and compactness of 0, we deduce that sup;^gA G L^(Xj). On the 
other hand, since £ has a moment of order r > 4, arguing as in the proof of 
point 3 in Lemma 6.2 we have that 



( 21 ) 


From A8 and A9 we have that {/„ is a G^ function and derivatives can be 
omputed by differentiation under the integral sign. This implies that 



and 




Similar expressions are obtained for the derivatives of [/(0) (replacing every¬ 
where F~j with F~^ = (pg/ o G~^). We write DUn{d) = {djUn{0))i<j<j, 

DU{9) = {djU{9))i<j<j for the gradients and = [dp^qUni9)]i<p^q<j, 

$(0) = [dp qU{9)]i<p^q<jioT the Hessians of Un and U. Note that 4>* = $(0*) is 
assumed to be invertible. 

Recalling that Rj = dipg* o tpg} , from the fact DU(9*) = 0 we see that 



(23) 
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Now, using Assumption TCL and arguing as in the proof of Theorem 3.1 we 
conclude that 


it)) 


in probability and, consequently, 

^djUn{e^) - - [ R, (G-i it)) 

j Jo 


dt 




dt 


0 (24) 


in probability. 

A Taylor expansion of djUn around 9* shows that for some 0" between 0" 
and 9* we have 

a,c/„(r) = d,u^{9*) + idf^Un{9]),. . . ,a}^-c/„(07)) • (r - r) 

and because 0" is a zero of DUn, we obtain 

-a,[/"(r) = idlu„i 9 ^),... ,a},c/„(0")). (r - r). 

Writing $„ for the (J—l)x (J—1) matrix whose J—1-th row equals ..., 9j^d7„(0")), 

j = 2,..., J, we can rewrite the last expansion as 

-V^DUni9*) = ^„^i9^-9*). (25) 

We show next that $„—>■$* = $(0*) in probability. Recalling (22), we 
consider first {d(pg„{F~p{t)))'^dt. We have 


< -'9v5e;(i^”p(t)))^di) ^ 

+ (^ (5v5e;(^^p(i)) -'9<^e;(^p”^(i)))^dt) ' 

< ( / sup\d^(px{F-l{t))\^dt\ ' \9^-9*\ 

^Jo aga a 

in probability, where we have used assumptions A9, TCL and Proposition 4.1. 
A similar argument shows that /giifign (F~p(t)) — (fig* (F~^(t)))^dt in probability. 
As a consequence, we conclude 


<i)„ —)> 4)*, in probability. 
21 


(26) 









Now, (25), (24) (26) together with Slutsky’s Theorem complete the proof. 


□ 


Proof of Theorem 4.3. We consider the same notation and setup as in 
the proof of Proposition 4.2. Since id{7„(d") = 0, a Taylor expansion around d” 
shows that 

nUn{e*) - = i(y^(r - r))'$(d„)(V^(r - e*)) (27) 


for some 6n between d" and 9*. Arguing as in the proof of Proposition 4.2 we 
see that <i>(0„) —>■ $* in probability. Hence, to complete the proof if suffices to 
show that 


nUn[e*) 


1 jJ2k=l 


in probability. Since 


nUr.{e*) = jY. 


1 {Pnjjt) j'l2k=l Pn,k(t)) 




9iG-Ht)y 


-dt, 


this amounts to proving that 

{pnjit) — 


Jo 9 iG-yt)y 

in probability. 

Taking i/ G (0, i) in Theorem 6.1 we see that 


dt —y 0 


nl- 


giG-ytW 


1 


-I-. 


dt < Op(l)-— 

m J- 




m-t)r 

9{G-Ht)y 


0 , 


using condition (AlO) and dominated convergence. From (AlO) we also see 
that —!► 0 in probability. Condition (AlO) implies also that 

Ji-i —>■ 0 in probability, see Samworth and Johnson (2004). Similar 

considerations apply to the left tail and complete the proof. 

□ 


Proof of Proposition 5.1. We set Tn = Wr{i^n,r]) and = Wr{vn,r]) 
and n„(77) for the set of probabilities on {l,...,u} x with first marginal 
equal to the discrete uniform distribution on {1,... ,n} and second marginal 
equal to r] and note that we have Tn = inf 7 rgn„(r;) if we denote 

= ( / \\Yi-zYdTiii.z) 
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We define similarly a'(n) from the F/ sample to get = inf^gn„(r;) But 

then, using the inequality |||a|| — ||6||| ^ ||a — 6|1, 

l/r . y/r 

= kFlir.-r/rl 

This implies that 

1 " 
n 

i—l 

If we take now {Y, Y') to be an optimal coupling of v and i/', so that E [||F — F'||’’] 
v') and {Yi,Y (),..., (Yn, Y^) to be i.i.d. copies of {Y, Y') we see that for 
the corresponding realizations of T„ and we have 

n 

E[|T„-T;n ^ -^E[||F,-F/|r] = lT.(:.,z.r- 

i=l 

But this shows that Wr{C{Tn), C{T^)) ^ Wr{v,v'), as claimed. 

□ 

Proof of Proposition 5.2. We write W,™ = Pr(pni,i, ■ • ■, Pnj,j) and 
K'n = • ■ ■, We note that 


|a(7r)-a'(7r)| 





\\Y,-Y:rd^T{^,z) 


V’' = 


inf / T(ii,... ,ij)d7r(ii,... ,ij), 
Ui,...,Uj) j 


7rGn(C/i 

where Uj is the discrete uniform distribution on {1,..., rij} and T(*i,..., ij) = 
min^gKd j We write T'{ii,..., ij) for the equivalent function 

computed from the F/,’s. Hence we have 


\T{iu ..., ijy/^ - ..., ijy/r j E - K 


j I 


j=i 


which implies 




l/r 






f=i 


j=i j=i \ ^ i=i 


So, 


1/1 

j=l \ i—l 
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If we take {Yj,Yj) to be an optimal coupling of i/j and and {Yij,Y(j ),..., 
{Yn-j,Y^. j) to be i.i.d. copies of iYj,Y-), for j = 1,..., J, then we obtain 


E [|K,„ 




The conclusion follows. 


□ 


Proof of Theorem 5.3. We can mimic the argument in the proof of Propo¬ 
sition 5.2 to get an upper bound on the Wasserstein distance between the laws 
of Vn and the corresponding version obtained from samples with underlying 
distributions p'. In fact, arguing as above, we can write 


= inf 

vea 


7rGn((7i 


inf / ... ,ij)d7r(ii,... ,ij) 

Ui,...,Uj) J 


where T(i^;zi,... ,ij) = min^^gR j We write T'(y); h, 

for the same function computed on the Z[j{ipys and set 

llv^'lloo := sup \ip'jix)\. 

x^{c‘,d) 

Now, from the fact {Zij{(p) — Z[j{(p)Y ^ see that 


and, as a consequence, that 

IP2 ..., - ¥2 (m'i "M, ..., P 


, J , 

4 EE-ii^' 

J n,- 

j=i 13=1 ^ 


and then 

K - ^ y'wijY^ {i- - xYf) . 

i=i 

If, as in the proof of Proposition 5.2, we assume that {Xij,X[ ^■), i = 1,..., 
are i.i.d. copies of an optimal coupling for pj and p', with different samples 
independent from each other we obtain that 


E [{Vn - ' 


^ ll¥>'ll 


2 E 

cso J 


i=i 
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□ 


Proof of Corollary 5.4. In Theorem 5.3, take and set := 

inf^gg Then, conditionally to the Xij,..., X^j, 

the result of Theorem 5.3 reads now 

1 

< sup ||(/ 7 '-||^ 

Now, let := inf^gg M {ip). Then, 

Wi{C{Vmr.).C{vl,J) = 

Now, recall that in the proof of Theorem 3.1 one gets that Hn,j) = 

Op{-^). Then, using that Wr{C{aX), C{aY)) = aWr{C{X), C{Y)) for a > 0, 
(28) gives 

W| - v)), C [v*^^ “'^))) (29) 

m 1 

^ ^ sup 11 (^' 11 - V nW| (pj 

Vn ^gg 4 ^ 


W^{C{Vm^-v)X{v*m^-v)) (28) 

2 1 
IkilL 

‘peg ‘J 


Moreover, under Assumptions Ml to M 6 , Theorem 3.1 gives ^/rn^ ^ 

7 . If u > 0, the classical Delta Method (see for instance in Van der Vaart (2000) 
p.25) gives 

i'^m„ -v) ^ — 7 . 

2w 

Hence (29) enables to say that that 





Applying again a Delta Method leads to 


(^inf - inf ^ 7- 

(7) is obtained by using Glivenko Cantelli Theorem and convergence of the 
empirical quantiles. 

□ 
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